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Abstract. A zero-sum differential game with controlled jump-diffusion driven 
state is considered, and studied using a combination of dynamic programming 
and viscosity solution techniques. We prove, under certain conditions, that the 
value of the game exists and is the unique viscosity solution of a fully nonlinear 
integro-partial differential equation. In addition, we formulate and prove a verifi- 
cation theorem for such games within the viscosity solution framework for nonlocal 
equations. 



1. Introduction 

In this article we analyze a two-player zero-sum stochastic differential game (SDG 
henceforth) where the state is governed by controlled jump-diffusions. For problems 
related to controlled degenerate diffusions, viscosity solution setup provides an ap- 
propriate framework for analysis. We mention [161 El HI US] to name a few of the 
available studies addressing this connection. In one such article [16], the authors used 
a combination of viscosity solution and dynamic programming techniques to pioneer 
a comprehensive study of zero-sum SDG. We extend these results to jump-diffusion 
driven games and in addition, we use viscosity solution framework for nonlocal equa- 
tions to formulate and prove a verification theorem, which is influenced by similar 
results in [T5] related to optimal control problems for diffusions. 

For a fixed positive constant T and t £ [0, T), let (p, t , T u Pt, Ft,-) be a filtered 
probability space satisfying usual hypotheses. The SDG consists of the following 
controlled stochastic dynamics, defined on (p, t , Tt, Pt, Ft,-) , 

(1.1) dX(s) =b(s, X(s); Y(s), Z{s))ds + a(s, X(s); Y(s), Z{s))dW{s) 

+ / rj(s,X(s~);Y(s),Z(s);w)N(ds,dw) 
Je 

where s £ (t, T]; with the initial condition 

X(t) = x (£ R d ), 
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and the pay-off functional 

(1.2) J(t, x; Y, Z) = E t,x [ J f(s, X(s); Y{s), Z{s))ds + g(X(T)) 

The a-algebra T t consists of subsets of fl t , Pt is a probability measure on (fi^J^), 
and J-~t,- is the shorthand notation for a filtration (J r t,s) t<s<T - Furthermore, E = 
M m \{0} for a positive integer m and W(s) is a fc-dimensional Brownian motion 
on the same probability space, cr's are d x k matrices, fe's and 77's are R d valued 
functions. N(ds, dw) is a Poisson random measure on E with intensity measure u(dw) 
and N(ds,dw) = N(ds,dw) — v{dw)ds; Y(-) and Z(-) are two predictable control 
processes with values in y and Z respectively. The sets 3^ and Z are two compact 
metric spaces, respectively representing the control sets of the two players I and II. 
i?*' 3 ^-] means the expected value of the quantity inside the brackets, and t, x at the 
superscript signifies that the state process X(s) starts at time t from the point x. The 
precise assumptions on a, b, 77, /, g will be stated later but roughly speaking, these 
are Lipschitz continuous in the state-variable and the possibly singular (at origin) 
Radon measure u, the so-called Levy measure, satisfies usual growth restriction. In 
the zero-sum scenario we conventionalize player / to be the minimizing player and 
player II to be the maximizing player. Before the players could start playing the 
game additional set of rules have to be specified, which we describe in the next 
section. Given that the players agree on this set of rules, a value of the game could 
then be defined. 

In the deterministic case [a = 77 = 0), it is shown under Isaacs condition that 
the value of the game exists and it is the unique viscosity solution of the un- 
derlying Bellman-Isaacs equation ( see |6] [151 E2])- In the stochastic case with 
j] = (pure diffusion), the study of SDGs prior to (16] was mainly restricted to 
problems where state is governed by non-degenerate diffusions and value functions 
were linked to classical solutions of second order equations (cf. [7J HE]). In [16], 
Fleming & Souganidis adressed the degenerate case and proved under similar Isaacs 
condition that the value of the game exists and is the unique viscosity solution of 
the underlying Isaacs equation which is fully nonlinear, second order, and possibly 
degenerate. 

In recent years, the use of jump- diffusions to realistically model price dynamics in a 
financial market is becoming increasingly popular (see [11] and references therein) . In 
such market models, the activities of market participants could often be formulated 
as differential games, where the states follow controlled jump-diffusions . We refer 
to [271 I2S] for more in this direction. These recent developments mainly focus on 
proving verification theorems in terms smooth solutions of underlying Bellman-Isaacs 
equations. With this attempt here, we extend the methodology of [TB] to look beyond 
the smooth solution setup and provide a rigorous and robust analysis for zero-sum 
SDGs related to controlled jump-diffusions. 

From an intuitive point of view, Bellman-Isaacs equation for the SDG fll.ip - fll.2p 
is a fully nonlinear integro-partial differential equation of the type 



(1.3) ut + F(t,x,Du(t,x),D 2 u(t, x), u(t, •)) =0 in [0,T) x R , 
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along with the terminal condition 

(1.4) u{T,x)=g{x) xeR d . 

The term u(t, •) is of special importance to the present article as it represents the 
nonlocal-ness of the equation, which results directly from the jumps in the dynamics 
(11. ip . In our context, the equation (II. 3p would primarily assume the two following 
forms 

(1.5) u t + H-(t,x,Du,D 2 u,u{t,-)) = in[0,T)xR rf , 

(1.6) u t + H + {t,x,Du,D 2 u,u{t,-)) = in[0,T)xM d , 
where, for (q, x, t, A) G M. d x W d x [0, T] x S d and a smooth function tp, 

H~(t, x, q, A, tp(t, ■)) = sup inf C(t, x, q, A; y, z) + J(t, x; y, z)tp 

zcz y&y L 



and 



H + (t, x, q, A, ip(t, •)) := inf sup C(s, x, q, A; y, z) + J(t, x; y, z)<p 



C(t, x, q, A; y, z) :=Tr(a(t, x; y, z).A) + b(t, x; y, z).p + f(t, x; y, z), 

J(t, x; y, z)(p := / [<p(t, x + r)(t, x, ; y, z\ w)) - tp(t, x) 
Je v 

— T](t, x; y, z; w).Dip(t, x) \ v(dw) 



with a = \oo T and S d is the set of all symmetric d x d matrices. 

The fully nonlinear integro-PDEs of type (II ,5p or (II .6p are called degenerate for 
the following reasons. The matrices a's are assumed to be merely nonnegative def- 
inite and may vanish at some points. Similarly, the jump vectors ry's may as well 
vanish. Consequently, there are no regularizing effects in these equations coming 
from the second order operator ("Laplacian smoothing") or from the integral oper- 
ator ("fractional Laplacian smoothing"). As a result, the equations (ll.3p - (ll.4l) will 
in general not have classical solutions, and a suitable notion of viscosity solutions is 
needed. In the past few years, there have been some efforts to extend the theory of 
viscosity solution to the integro-partial differential equations [H [3l HI [231 121] • This 
theory is not as developed as its (pure) PDE counterpart, but the available results 
suffice to ensure the existence, uniqueness, comparison principles, and some regular- 
ity estimates. Next, we mention a few points describing the technical differences in 
our problem with the existing literature. 

In [TB] the game problem is defined on the Wiener space Co([£, T] : R d ) and the 
structural richness of this space plays a very crucial role in the analysis. When the 
stochastic evolutions are driven by Levy processes, the underlying sample space is 
required to reflect that. In our view, the so-called Wiener- Poisson space would be 
a proper choice for the underlying probability space space. Part of the subtlety for 
our analysis of the SDG lies in justifying necessary technical assertions related to 
the sample space. 
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Classically, verification theorems (see [TFJ for v = and [251 [27] for jump-diffusions) 
are formulated in terms of smooth solutions of the underlying Bellman-Isaacs equa- 
tion and set up criterion for a set of controls for the players to be optimal. But, as 
has already been pointed out, the Bellman-Isaacs equation does not have classical so- 
lutions in general, solutions have to be interpreted in the viscosity sense. Therefore, 
a verification criterion in terms of viscosity solutions will have wider applicability. 
A verification theorem in the framework viscosity solutions for first order Bellman 
equation first appeared in [35]. In the context of pure diffusions, a similar result 
appeared in [36] for optimal control problems, but with some technical inconsisten- 
cies, which was later corrected in [191 ED] . We follow the ideas from [191 EH], and 
formulate a nonlocal version of this result for SDGs. Even when the jumps are ab- 
sent, we point out that such a verification theorem is new for differential games. We 
also mention that discontinuities of the sample paths and non-locality of the Isaacs 
equation makes the problem more involved, and new techniques are employed to 
overcome the added difficulties. 

The rest of the paper is organized as follows: in Section 2 we state the full set 
of assumptions, relevant technical details and state the main results. Sections 3 & 
4 respectively contains the proof of dynamic programming principle and verification 
theorem. 



2. Technical framework and the statements of the main results 

We use the notations Qt and Qt respectively for [0,T) x R d and [0,T] x ~R. d . 
For various constants depending on the data we mainly use N,K,C with/without 
subscripts. For a bounded Lipschitz continuous function h{x) defined on M. d , its 
Lipschitz norm \h\\ is defined as 

1^:= sup 1/^)1+ sup 

x<m. d x,y&R d \ X V\ 

We denote the space of all h so that \h\i < oo by W 1,00 (M. ) or sometimes only by 
W 1 ' 00 . We also define 

C?\Q T ):={h(t,x): sup \h(t,x)\+ sup \ h (t, ^- h(s,y)\ < ^ 

(t,x)eQ T (t,x),(s, y )eQ T \t - s\ 2 + \x — y\ 

Furthermore, \h(t, -)|i simply stands for | • \i norm of h(t, function of x 

alone with t being fixed. Let C 1,2 (Qt) be the space of 'once in time' and 'twice 
in space' continuously different iable functions. We denote the set of all upper and 
lower semicontinuous functions on Q T respectively by USC(Qt) and LSC(Qt)- A 
subscript would mean polynomial growth at infinity, therefore the spaces USC p (Qt), 
LSC p (Qt), Cp' 2 (Qx) contain the functions h respectively from USC(Qt), LSC(Qt), 
C 1,2 {Qt) satisfying the growth condition 

\h(x)\ < C(l + \x\ p ) for all x G M. d (uniformly in t if h depends on t). 

We identify the spaces USC (Qt) and LSC (Qt) respectively with USC^Qt) and 
LSCb(Qr)] the subscript '6' signifies boundedness. 
Now we list the precise set of assumptions. 



STOCHASTIC DIFFERENTIAL GAMES 



5 



(A.l) The spaces y and Z are compact metric spaces; the functions o~,f,b and 77 
are continuous both on y and Z, uniformly with respect to (£, x) G [0, T] x M. d 
and additionally with respect to w G M m for 77. 

(A. 2) /, b, a, i] are bounded and continuous with respect to t (and w for 77), uniformly 
in other entries, and there exists a positive constant K such that 

(\f\ 1 + \b\ 1 + \a\ 1 )(t,-;y,z) + \g\ 1 <K, 

uniformly in (t;y,z;w) and 

\r](t,-;y,z;w)\ + \q(t,-',y,z',w)\x < Kvt\m.{\w\, 1). 



(A. 3) In concurrence with (A. 2) in this case the Levy measure v is a positive 
Radon measure on E and satisfies 

(2.1) / min(|«;| 2 , l)v{dw) < 00. 



Remark. The assumptions (A.l) (A. 3) are natural except for the boundedness con- 
straint. However, it is possible to allow certain growth properties and the results of 
this paper are still valid in a properly modified form. The jump vectors 77 can also 
enjoy some polynomial growth at infinity in w, in which case the Levy measure has 
to have appropriate decay property at infinity. 

2.1. Viscosity Solutions for Integro-PDEs. The notion of viscosity solution for 
nonlocal equations ( such as ( U.3p ) could be defined in various ways (e.g. jH [23]). 
but it is not very hard to establish the equivalence. We use the following definition 
from [23] . 

Definition 2.1. For F = H + or H~, v G USC p (Q T )(v G LSC p (Q T )) is a viscosity 
subsolution (supersolution) of ( II. 3p if for every (£, x) G Qt and <f> G Cp' 2 (Qx) such 
that (t, x) is a global maximum (global minimum) of v — (J), 

<Pt + F(t, x, D<f>, D 2 cf>, <f>(t, •)) > 0(< 0). 

We say that v is a viscosity solution of (II. 3p if v is both a sub- and supersolution of 

m- 

The following wellposedness theorem holds, a proof of which can be found in 



Theorem 2.1. Assume (A.l), (A.2) and (A.3) Then, for F = H + or F = H 



there exists unique viscosity solution u to the terminal value problem (ll.3p - (ll.4p and 
a constant N depending only on d, K, T such that 

(2.2) \v\i tl < N. 

Furthermore, a comparison principle holds: If u and u are bounded sub- and super- 
solutions of ( ll.3p - (ll.4p with F = H + or H~ and u(T, ■) < u(T, ■), then u < u in 
Qt- 

The case H + = H~ is of special interest to the present context. We formally say 
that the Isaacs condition is satisfied if, for all (q, x, t, A) G K^xl^x [0,T] x § d and 
for every smooth function f, 

(2.3) H + (t, x, q, A, <p(t, •)) = H~{t, x, q, A, <p(t, •))• 



6 



IMRAN H. BISWAS 



2.2. The Canonical Sample Space. The structural properties of the underlying 
probability space play an important role in dealing with the technical subtleties 
involved in the game problem. Contrary to [TH], there are jumps in the controlled 
evolution and we find it convenient to follow |HJ 121] and work in a canonical Wiener- 
Poisson space which is described as follows. 

For a positive constant T and < s < t < T, let Ql t be the standard Wiener 
space i.e. the set of all functions from [s, t] to W 1 starting from and topologized by 
the sup-norm. We denote the corresponding Borel cx-algebra by and let P\ t be 
the Wiener measure on (0^,23°). 

In addition, upon denoting Q* t = [s,t] x (M m \{0}), let Q 2 t be the set of all 
NU{oo}-valued measures on (Q* t , B(Q* st )) where £>(Q*J is the usual Borel a-algebra 
of Q* t . We denote B\ to be the smallest cr-algebra over so that the mappings 
q G Q 2 t i— > q(A) G N U {oo} are measurable for all A G £>(Q* t ). Let the co-ordinate 
random measure N S:t be defined as N s>t (q, A) = q(A) for all q G Q 2 S t , A G B(Q* t ) and 
denote P 2 t to be the probability measure on (Q 2 t , B®) under which iV Sji is a Poisson 



random measure with Levy measure v satisfying (A. 3) 



Next, for every < s < t < T, we define Q 9)t = ft* t x ft* t , P Sjt = P} t ® P 2 t and 

B Stt = Bi ® B% i.e. the completion of B\®B\ with respect to the probability measure 
P Sj t- We will follow the convention that Q t ,T = &t an d Bt,T = T t . A generic element 
of Q t is denoted by u = (wi,^), where Ui G Q\ T for i G {1, 2}, and we define the 
coordinate functions 

Wl{u) = ui(s) and N'ioo, A) = u 2 (A) 

for all < t < s < T, u G Q, A G B(Q^ T ). The process W l is a Brownian motion 
starting at t and N f is a Poisson random measure on the probability space (f2 t , F tl P t ), 
and they are independent. 

Also, for t G [0, T], the filtration J 7 ^. = (J-i iS ) sG ^T] is defined as follows: 

P t>s = JV*(A) : A G B(Ql r ),t <r<s}, where t<s<T. 

We make J^. to be right- continuous and denote it by Finally, we augment J 7 ^ 
by P r null sets and call it J-" t) .. As and when it necessitates, we extend the filtration 
T t> . for s < t by choosing T t , s as the trivial a algebra augmented by P r null sets. 
We follow the convention that J-^t — 3~t- When the terminal time T is replaced by 
another time point, say r, the filtration we have just described is denoted by J 7 ^. . 

Finally, note that the space Q s j is defined as the product of canonical Wiener space 
and Poisson space. Therefore, for any r G (t,T), we can identify the probability 
space (jit, J-'t,-, Pt) with (i\ r x Q T1 Tl. <S> J-" Tt .,Pt jT ® P T ) by the following bijection 
7i : Q t — > Q t ,r x ^V- F° r a generic element u = (u)x,u)2) G = Q] T x T , we define 

u/' r = (wi|[t iT ], w 2 |[ tiT ]) G fi t)T 

uT' T = ((U)i - UJi(t))\[ t ,T],^2\[t,T]) G fi T ,T 
7T(w) = (w*' r ,W T ' T ) 

The description of the inverse map ff^ 1 is also apparent from above. 
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2.3. Rule of the game. The player I controls Y(-) and player II chooses Z(-) 
respectively to minimize and maximize J. At any given time s G (t,T), the players 
know (X, Y, Z) (r) for r < s and instantaneous switching at s is possible. Therefore 
the player who acts first at s is apparently at disadvantage. We follow [16] to tackle 
this problem and formalize two approximate games, namely the upper and lower 
game. For the lower-game, the player I is allowed to know Z(s) before choosing 
Y(s), and for the upper-game, player II has the upper hand of knowing Y{s) before 
choosing Z(s). Next step would be to define upper and lower value of the game. 
Before that, we need to define the concepts of admissible controls and strategies for 
the players. 

Definition 2.2 (admissible control). An admissible control process Y(-)(resp. Z(-)) 
for player /(resp. player II) on [t, T] is a ^(resp. Z)-valued process which is 
predictable. The set of all admissible controls for player /(resp. II) on [t, T] is 
denoted by M(t) (resp. N(t)). We say the controls Y, Y G M(t) are the same on [t, s] 
and we write Y ~ Y on [t,s] if P t (Y{r) = Y(r) for a.e. r G [t, s]) = 1. A similar 
convention is followed for members of N(t). 

Finally, if Y G M(t), then for every s G [t, T] there exists Y s (-) : [t, s] x fi M -)■ y 
such that Y(r,u) = Y s (r,u s ) where r G [t, s],co G Q t , u s = oj\\ t;S \ and Y s (-) is a 
J 7 /. -predictable process. 

Remark. In comparison with [16J, we require the control processes to be predictable 
so that the integrand rj(-) in (11. ip is also predictable. Also, as pointed out by one 
reviewer, any J-^.-predictable control process Y will have an J-^-predictable version 
which will have the representation as described above. 

Definition 2.3 (admissible strategy). An admissible strategy a (resp (3) for player 
/ (resp. II) is a mapping a : N(t) -> M(t) (resp. f3 : M(t) -> N(t)) such that if 
Y(-) w y(resp. Z w Z) on then a[Y] w a[f] ( resp. w ) on [t, s] 

for every s G [t, T]. The set of admissible strategy for player I (resp. II) on [t,T] is 
denoted by T[t] (resp. A(t)). 

Definition 2.4. (Value functions) 

i. ) The lower value of the SDG fll.ip - fll.2l) with initial data (t, x) is given by 

(2.4) U(t,x):= inf sup J(t, x; a[Z], Z) . 

aer(t) zcN(t) 

ii. ) The upper value of the game is defined as follows, 

(2.5) V(t,x):= sup inf j(t,x;Y, (3[Y]). 

We say that our game has a value in the sense of Elliot & Kalton [T3] if V(t, x) = 
U(t,x) and call this common value to be the value of the game. The upper and 
lower values satisfy the following dynamic programming principle, a detailed proof 
of which is given in Section 3. 



Theorem 2.2. Le^ |(A.l)|(A~2^1f(A~3)1 hold and t,r G [0, T] be such that t < r. For 
every x G M d , we have 



(2.6) V(t,x)= sup inf E t,x { / f(s, X(s); Y(s), (3[Y](s))ds + V(r, X T ) 
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where X(-) is the solution of ([HI]) with Z(-) = P\Y](-) for Y(-) E M(t), and 

(2.7) U(t,x)= inf sup [ f(s,X(s);a[Z)(s),Z(s))ds + U(r,X T )} 

aer(t) z&N(t) L Jt ) 

where X(-) is the solution of ([HE]) with Y(-) = a[Z]{-) for Z(-) e N(t). 

The proof of Theorem l2.2l is not based on probabilistic techniques alone. Following 
we first prove a part of the following viscosity solution connection, and then use 



it to prove Theorem 12.21 The statement of the theorem reads is given below, a proof 
of which is given in Section 3. 

Theorem 2.3. Let \( A. l)l(A~2)\ and [(X3)] hold. Then the upper-value V and the 
lower-value U of the game (ll.ll) - (ll.2p are respectively the unique viscosity solutions 
of (HSD-dHD and QH-Oj). 

Remark. It is now obvious that if the Isaacs condition (12.31) holds, then uniqueness 
of viscosity solution of IPDEs forces the upper and lower value of the game to coincide 
in view of Theorem 12.31 This ensures existence of the value, in the sense of Elliot & 
Kalton 114], of our SDG. 



2.4. Stochastic Verification Theorem. Before the verification theorem could be 
formulated, some further technical preparations are needed. Given a probability 
space (f2, T, P) with a filtration J- aj . = {J-" a ,.s : a < s < b} and a separable Banach 
space B with norm | • |b and 1 < p < oo, the space Lj^ (a, b; B) is defined as follows: 

LF-p a (a, b; B) = j(/>(s, oo), a < s < b\(f)(s, •) is an JF a s — adapted, B — valued 

measurable process on [a, b] and £'( / \(f)(s,u)\^ > ds) < oo >. 

J a 

Definition 2.5. We say that a triplet (p, q, Q) e R x R d x S d is in Dl'++v{s, x), the 
second order one-sided parabolic superdifferential of v at (s,x), if for all y G M d and 

r > s, 

v(r, y) < v(s, x) + p(s — r) + (q,y — x) + (Q(y — x),y — x) + o(\s — r\ + \y — x\ 2 ). 

The second order one sided parabolic sub differential of v at (s,x); Dl+~v(s, x) is 
defined by reversing the above inequality i.e. Dl+~v(s, x) = —D l s '^ + x {—v{s,x)) 

We state the following lemma, well-known in context of viscosity solution theory, 
characterizing super and subdifferentials. 

Lemma 2.4. Let v e USC([0,T] x R d ) and (s Q ,x ) e [0,T) x R d . Then (p,q,Q) G 
D s 'o+3; v ( s Oi x o) iff there exists a function tp e C 1,2 ([0, T] x R rf ) such that v — (p has 
a strict global maximum at (sq,xo) relative to the set (s,x) such that s > sq and 

(2.8) [(p,ip t , Dip, D 2 (p](s ,x ) = [v(s ,x ),p,q,Q]. 
Furthermore, ifv(t,x) has polynomial growth, i.e. if 

(2.9) \v(s,x)\ < C(l + \x\ k ) for some k>l and (s,x) e [0,T] x R , 

then <p can be chosen so that (p,(ft, Dip, D 2 ip all satisfy the same growth condition 
(12. 9p . possibly with a different constant in place of C. 
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A detailed proof of Lemma 12.41 could be found in [31], (Lemma 5.4, Chapter 4. 
to be precise). The following equivalent characterization of Definition 12.11 holds. 
The proof is similar to the local case and follows by combining Lemma 12.41 and the 
reasoning [TSJ p. 2012]. For the sake of completeness of our presentaion, we sketch 
the proof Lemma 12.51 in the Appendix. 

Lemma 2.5. A v G USC(Qt) is a subsolution of ( II. 3p with F = H + or H~ , if and 
only if, for all (t, x) G Qt and (p, q, Q) G D t ' 2+ v(t, x) 

p + F(t,x,q,Q,<p(t,-)) > 0, 

where tp = <p(p,q,Q) given by Lemma [2^41 satisfying (12. 8p at (t,x). 

With slight abuse of notation, for the rest of this section we denote the space of 
all functions v G C l ' 2 (Q T ) with v,Dv and D 2 v(t,x) satisfying (J22D by C]: 2 (Q T ). In 
fact, (Q T ) is a separable Banach space with respect to the usual weighted norm. 
We are now ready to phrase the verification theorem. 

Theorem 2.6 (Verification Theorem). Assume (A.1)|(A.2) , (A. 3) and the condi- 
tion (12. 3p holds. Let u, v G C±(Qt) be respectively a sub and supersolution of (11.51) 
satisfying (II. 4p . Fix any (t,x) G Qt- Let (Y*,Z*) G M(t) x N(t) be an admis- 
sible control pair for the SDG (ll.ip - (ll.2l) starting at (t,x) and X*(-) be the corre- 
sponding solution of (11.11) . Suppose that there exist cadlag processes (p\ q\ Q % \ $*) G 
L% (t, T; R) x L? Tt (t, T; R d ) x L% (t, T; S d ) x L 2 Tt (t, T; C l { 2 (Q T )) for i G {1,2} with 
$ l progressively measurable, fori G {1,2} ; such that 

a. ) for a.e. s G [t, T] and i = 1 

(2.10) (p^g^Q 1 ^)) G D l s ' 2+ u(s,X*(s)) and 

u — $J has a global maximum at (s, X*(s)) with $*(s, X*(s)) = u(s, X*(s)) 
Pt-a.s. and 

(2.11) J\p\s) + C(s, X*(s) 1 p 1 (s),q 1 (s),Q 1 (s); Y*(s),Z*(s)) 

+ J(s,X*(s);Y*(s),Z*(s))<S>l(s,X*(s))}ds} < 0. 

b. ) For a.e. s G [t, T] and i = 2 

(2.12) (p 2 (s),q 2 (s),Q 2 (s)) G Dl' 2 ~v(s,X*(s)) and 

v - § 2 has a global minimum at (s,X*(s)) with $ 2 (s,X*(s)) = v(s,X*(s)) 
P t -a.s. and 



(2.13) J [p 2 (s) + C(s,X*(s),p 2 (s),q 2 (s),Q 2 (sy,Y*(s),Z*(s)) 

+ J(s,X*( S y,Y*(s),Z*(s))$ 2 s (s,X*(s))]ds} >0. 

Then (Y*, Z*) is an 'optimal' control-pair for the SDG in the sense that 

(2.14) U(t, x) = V(t, x) = J(t, x; Y*, Z*). 



10 



IMRAN H. BISWAS 



Remark. The redundancy in the above statement is apparent for following reasons. 
Given the assumptions (A.1)|(A.2) anc j(A.3j . if is progressively measurable, the 



integrability condition on (p l ,q\Q l ) is automatically satisfied and one can replace 
them by derivatives of at (-,X*(-)). Therefore, it is possible to equivalently 
state the theorem without introducing (p\ q l ,Q l ). However, we adopt this particular 
format on purpose. As has already been mentioned, even for pure diffusions, so 
far no verification theorem has been formulated for SDG using viscosity solution 
framework. In such a scenario, an appropriate formulation would be to drop and 
leave the statement in terms of semijets only. 

3. Proof of dynamic programming principle 

We start this section with the following observation as an immediate consequence 
of the definition of admissible controls and the remark following the definition. We 
state this CIS db lemma for later reference. 

Lemma 3.1. Let < t < t < T and Y(-) G M(t). Then, for P^-a.e. u 1 G Vt u , the 
map Yi^uj 1 ) : [t, T] x Q t — > y defined by Y{u l ){r, uj 2 ) := Y(r, 7r _1 (a; 1 , uj 2 )) is a version 
of an Ft, -predictable process. A similar assertion holds for members of N(t). 

As has been pointed out in Section 2, on the probability space (f2 t , J 7 , J-f,., P t ) , 
there exists unique solution X ttX (-) of the SDE (II. ip for any 4-tuple (t,x,Y,Z) G 
[0,T) x R d x M(t) x N(t) i.e. 



(3.1) X t:X (s) = Xt, x (j) + J b(r,X t>x (r)^(r))dr + J tr(r,X M (r);7(r))dW^(r) 

+ / / r](r,X tiX (r~);>y(r);w)dN t (dr,dw), 



E 



where r < s <T and 7(-) is a shorthand for the pair (Y(-), Z(-)). For any r G (t, T] 

and u t ' T G Q t ,r,^ T,T G Q T , we define 

j(r,u t ' T ,^ T )= 1 (r,7r- 1 (u^,u T ' T )) 
and A(s,u/' T ,u; r ' T ) = X t , x (s, vr" 1 ^, u T ' T )). 
In addition, for P t T -a.e. u t,T G f^ r , we wish to have 



(3.2) X(s,u t ' T ,-) = X t , x (r) + J &(r,A(r,u/V);^V'V)K 

+ J a(r, X(r, , •); j(r, u/' r , -))dW T (r) 

+ f f r](r,X(r~,u t ' T ,-);j(r,uj t ' T ,-);w)dN T (dr,dw). 
Jt Je 

For r G [t,T], it follows straight from the definition that 

For the Poisson random measure, it also follows from the definition that 

(n-\u^,^ T ))(A)=ul T (A) 
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where A is any Borel subset of [r, T] x M m \{0}. Therefore, for P tr -a.e u t,T G 1\ T , 
the processes W^(7r~ 1 (u t ' T ,u T,T )) — W l r (jr~ 1 (u t ' T , w r ' T )) and the random measure 
N t (7r~ 1 (uj t ' T , uj t ' t )) respectively coincides with the canonical Brownian motion WJ 
and the canonical Poisson random measure N T on the probability space (fl T , T T ,., P T ). 
Therefore, for F tr -a.e. cu t,T G £\ r , the equality (13. 2 p holds as a consequence of 
(13. ip . We invoke the uniqueness for the SDE (II. ip to conclude that the paths of 
X(s, u/ ,T , -)se[r,T] w iH coincide with those of the solution of (II. ip on Q T with initial 
condition (r, X t tX (r)) and control pair [as declared in Lemma I3TT] (Y(o> t,T ), Z{oj t,T )){-) 
, for P t T -almost all u t,T . Unless otherwise mentioned, we use the same notation X ttX 
when it is considered as a process on (0 T , P T ) and we actually mean the process X 
on(0 T ,P T ). 

Lemma 3.2. Let X tjX (-) be the solution of (II .ip for any A-tuple (t,x,Y(-), Z(-)) G 
[0,T) xR d x M(t) x N(t). For any bounded continuous function ip, and s G [t,T] 
(deterministic), it holds that 

(3.3) E t ^{XUs),l{s))\FtA{*~\^\^ T )) 
^■( r »[^(I M ( S ),7( S ,^> T ' T ))], P t , T - a.s. 

Proof. For a bounded and measurable function ip, we have 

(3.4) E Pt [^(uj)\^ T }(n-\uj^,u T ' T )) 

=E PM [ yj ( 7r -i( w *.r ) ^' T ))|^ T ® J- T ° r ] (o;*' r , u T > T ), 

where J^ T is the trivial a algebra on the proability space (Q T ,P T ). Therefore 
E Pt \ ip(u)\J : 't >T \ (7r~ 1 (uj t ' T , io T ' T )) is J r [ T ®J~^ T measurable. Thereby applying Fubini's 
theorem we conclude that, for P t T -&.e. u) i)T G £\ T , the map u T ' T (->■ E Pt [<p(lo) \ ^Ft,r\ 
(ty^ 1 (uj t ' T , uj t ' t )) is J-® T measurable. In other words, E Pt [^(u)^^] (7r~ 1 (u/'' r , •)) is a 
constant function on Q T for P t T -&.e. oj t,T G £\ r . For A G J 7 ^ we can write 

/ ^^(^(tt- 1 ^,-))^ 

= / / E^^Ft^lt- 1 ^ ^^dPt^dPr 

Jn r J a 

= [ E p '[ip{u)\^ T ]dP t {u) 

Jtt- 1 {AxQ. t ) 

= [ <p(u)dP t (u) 

Jn- 1 (Axn T ) 

= [ [ ^(n- 1 ^ ,c^ T ))dP> T ' T )dP iiT (u/' T ) 
J a Jn T 

= [ ^[^(vr- 1 ^,^))]^^). 

J A 

Therefore, for P t T -&.e. u t,T G fit )T , we have 

(3.5) E p *[<p\T t , T ](ir- 1 (u t > T ,u)- r > T )) = E^ly^- 1 ^^?))]. 
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Now define <p(oo) = i(j(X ttX (s,uj), r y(s,uj)), use (13.51) and invoke the description of 
X tjX (-) next to Lemma I3~T1 to conclude, for P tT -a..e. u t,T G 1\ T , that 

^^(X, ;c ( S ), 7 ( S ))|^ iT ](7r- 1 (^,^)) 

= E p ^(u)\^ T }(7T- 1 (u t ' T ,u T ' T )) 

= E p r [iP(X t , x (s, 7T- V r , ^ T )), 7(s, ^' r , uj t > t )} 

□ 



Lemma 3.3. Le^ |(A.l)|f(X2)]j(A.3)| hold. Then 

a. ) for every Y G M(t), Z G -AT(t), a G r(t) and /3 G A(i) ; £/ie pay- off junctionals 

J(t, - ;Y, /3[Y]) and J(t, -;a[Z],Z) are bounded and Lipschitz continuous in x, 
uniformly in t,Y, Z,a, (3. 

b. ) The value functions U and V are bounded and Lipschitz continuous in x. 

This lemma is a consequence of Lipschitz continuity and boundedness of the data, 
moment estimates for the stochastic processes, and Gronwall's inequality. The details 
of the proof will be given in the Appendix. 

In order to prove the DPP, it does not seem to be possible to replicate the same 
strategy available for proving DPP for deterministic games. There will be serious 
measurability issues. We follow [TB] and work around this problem with a restricted 
class of strategies for both the players which we name as r-strategies, keeping in line 
with [TBI. 



Definition 3.1. An r — strategy (5 for player // on [t,T] is an admissible strategy 
with the following additional property: For every t < t < T and Y(-) G M(t), 
the map (r, oS) i — > j3[Y(uj t ' t )](r,uj t ' T ) is ^.-predictable, where F(u/'*) is defined in 
Lemma [3. II The set of all r — strategies for player // on [t,T] is denoted by Ai(t). 

The r — strategies for player I are similarly defined on [t, T] and the set is denoted 
by We restrict the choices of the players only to the r-strategies and define 

the r-upper value and r-lower value of the game as follows: 

Definition 3.2 (r- values). 

i. ) The r-lower value of the SDG fll.ll) - fll.2p with initial data (t, x) is given by 

(3.6) Ui(t,x) := inf sup J(t,x;a[Z],Z). 

«eri(t) zeN(t) 

ii. ) The r-upper value of the game is defined as follows, 

(3.7) Vi(t,x):= sup inf j(t, x; Y, /3\Y]). 

As a corolllary to Lemma 13.31 one can derive the following regularity properties 
of the r-value functions. 

Corollary 3.4. 

a.) The r-value functions U\ and V\ are bounded and Lipschitz continuous in x, 
uniformly in t. 
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b.) For every (t,x) G [0,T] x R d 

U x (t,x) > U(t,x) and V x {t,x) < V(t,x). 

Proof. The proof of part [b.)} is obvious. The argument for part [a.)} is exactly the 
same as Lemma 13.31 □ 



The r- value functions do not satisfy the equalities in Theorem 12.21 (dynamic pro- 
gramming principle), each of them instead satisfies an inequality. We have the fol- 
lowing theorem. 



Theorem 3.5. Le* |(A.l)|(A^2)1|(A.3)| hold and t, r G [0, T] be such that t < r. For 
every x G M. d , we have 

(3.8) Ki(*,x)> sup inf W f f(s, X(s);Y(s), /3[Y](s))ds + V 1 (t, X(t))\ 

where X(-) is the solution of ([HI]) with Z(-) = /3[Y](-) for Y(-) G M(t), and 

(3.9) U x (t,x)< inf sup I f(s, X(s); a[Z](s), Z{s))ds + U^t, X(t))\ 

aer x (t) Z £N(t) tJt > 

where X(-) is the solution of (THED with Y(-) = a[Z)(-) for Z(-) G N(t). 

Proof. The proofs of (13. 8 P and (13. 9p are similar to one another, we only provide the 
details for (13. 8p . Fix (t, x) G Qt and define 

(3.10) W(t,x)= sup inf f(s,X(s);Y(s), p[Y](s))ds + V 1 (t, X T )\. 

/36A!(t)^eM(t) lj t ) 

For every e > 0, then there exists /3 € G Ai(t) such that 

(3.11) W(t, x) < E^[ ^ f(s, X(s); Y(s), F[Y](s))ds + V^r, X T )} + e, 

for every Y(-) G M(t). Recall the definition of Vi(t,x) and argue for every £ G M. d 
that there exists G Ai(r) such that 

(3.12) < J{t,&Y,P*\Y]) +e for every F G M(r). 

Next consider a partition (-Bj) ieN of W 1 where 5j's are Borel sets and fix G 
By Lemma 13731 and Corollary 13.41 J's and V\ are Lipschitz continuous in x uniformly 
with respect to other variables. Therefore it is possible to choose the diameter of 
Bi§ small enough such that, for all p G Bi, Y G M(r) and j3 G Ai(r), 

(3.13) \J(T,fr,Y,f3[Y))-J{T,p;Y,{l[Y))\<€ 
and 

(3.14) |^i(t,6)-^i(t,p)| <e. 

We now define a strategy 5 for the player 77 as follows: for (r, lo) G [£, T] x £7 t and 

y g M(t), 



«5[y](r) 



/3 e [y](r,w) if re[t,r] 

E l eNXBAXtAr))^[y^ t ' T W,^ T ) if re (r,T], 
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where n(u) = (u t > T ,u T ' T ) G Q t ,r x M T , ^(^ <,T )(-) G M(r) is the ^.-predictable 
version mentioned in Lemma [3.11 and X(-) is the solution of (II. ip with the control 
pair (Y, (3 e [Y}). If Y is predictable, then by very definition is also predictable. 

All other defining properties of an r-strategy is built within the definition of S. In 
other words, 5 G Ai(£). For i G N such that X(t) G B i7 we must have 

(3.15) ^(t,&) < J(a(r);^[y(^)],y(^)) + 2e, 

for all Y(-) G M(t) and for P ijT -a.e. u/' T G fi*' r . Also 

J(M;Y,5[y]) 

^ f(s,X( S );Y( S ),6[Y](s))d S 



J2xbAX(t))[ I f(r,X(r);Y(r),5[Y](r))dr + g(X T )]\ 
E^[j^ f(s,X( S );Y(s),F[Y](s))ds 

+ J2xbAX(t))E[ f ' ftr,X(r);Y(r),8[Y](r))dr + g(X T )\F t>T ] 

J' f(s,X( S );Y(s),F[Y](s))ds 

+ £ XbAX(t))J{t, X(t); Y(Jn, 0HY(^' T )\) } 

r/( S ,X( S );r( S ),/? e [y]( S ))^ + ExB l (X(r))V 1 (r,e t )}-2e 

jT /(a, X(s); Y(s),F[Y](s))ds + V x {r, X(r))} - 3e, 

where we have used Lemma 13.21 to deduce the third equality and the inequalities 
(I3.13p . (13.141) and (13.151) from above for the rest. Finally, invoke A3. 11 j) to conclude 

W(t,x) < J(t,x;Y,5[Y]) +4e 

implying 

W(t,x) < Vi{t,x) +4e, 
which leads to the desired conclusion (13.81) by letting e 4- 0. 

□ 

As a corollary to Theorem 13.51 we derive the following Holder continuity estimate 
in time for JJ\ and V\. 

Corollary 3.6. There exists a constant C > 0, depending on the data, such that 

|Vi(t,x) - Vi(s,x)\ + \U x {t,x) - Ux{s,x)\ < C\t-s\* 
for every t,s G [0, T] and x G M d . 
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Proof. Without loss of generality we may assume < s < t < T and \t — s\ < 1. It 
follows as a consequence of (13. 9p that 

Ui(s, x) — Ui(t, x) 

< inf sup E s ' x { [ f^X^ir^aiZK^^ir^dr + Ux^X^-U^x) 
aeri(t) z(-)eN(t) ^J s 

<c(\t-s\ + E s > x (\X s , x (t)-x\)), 

where we have used the uniform Lipschitz continuity of Ui(t, x) in x and the bound- 
edness of the data. Also, the usual first-moment estimate (Lemma lA.lj) for SDE 
(II. ip implies 



E s ' x (\X SiX (t)-x\)j <Ky/\t=7\. 
We combine the above estimates to conclude 



(3.16) U 1 (s,x)-Ui(t,x)<Cy/\t-s\. 
For any Z(-) G N(t), we define Z(-) e N(s) as 



Z(r,u) 



Z{t,u s *) if re[s,t] 
Z(r,u s ^) if re(t,T\. 

For any a G Fi(s), we define a G Ti(t) as 

a[Z) = {a[Z\){uj s,t ) (as described in Lemma I3TT1 ) 

and it is easy to see that a does not depend on u s,t . For a G Fi(s), we now have 



J(s,x-a(Z),Z) = E s > x / f(s,x-a[Z](r),Z(r))dr + g{X S!X (T)) 

J s 

= E s ' x [ J f(s, x- a[Z\{r),Z{r))dr + J(t, X S)X (t); a[Z],Z) 

> -C(\s -t\+ E s > x (\X SjX (t) - x\) + J(t, x- a[Z], Z)), 
where we have used Lemma ( 13. 3p . This implies 



sup J(s,x;a[Z],Z) > -C(\s - t\ + E s < x (\X s , x (t) - x\) + U^t, x) 
zeN{s) 

i.e. Ui (s, x) - U x (t, x) > -Cy/\t - s\ , 



which, in combination with ( 13 . 1 6j) . proves the Holder continuity estimate for U\. A 
similar set arguments works for V\ as well. 

□ 



The Corollary 13. 6[ along with Lemma I3T3| ensures that U\ and V\ are continuous in 
(t, x). The inequalities ( 13 .9p and ( 13. 8 \ are referred to as dynamic subprogramming and 
superprogramming principles in the literature. These terminologies are also consistent 
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with the following fact: ( 13. 9 j) will imply that U\ is a subsolution to the integro-PDE 
(jl.6p and (13.81) will imply that V\ is a supersolution to the integro-PDE (11.51) . We 
prove this fact in the next theorem. 

Theorem 3.7. The r -upper value (resp. lower valued function V\ (resp. U\) is a 
viscosity supersolution (resp. subsolution,) of (II. 6p (resp. ( 11.51) ). 

Proof. We only prove that U\ is a subsolution to the IPDE (II. 5p . the proof of V\ 
being a supersolution is similar. Let <p be a test function and Ui — ip has a global 
maximum at (to,Xo) 6 [0, T) x R d . Since the value function U\ is bounded, without 
any of generality, we may assume that the test function is bounded and has bounded 
derivatives up to second order. In view of definition (12. ip . we must show 

(3.17) d t (f(t , x Q ) + H~ (t , x Q , Dip (t , x ), D 2 ip(t , x ), (p(t , ■)) > 0. 

Let us assume the contrary, i.e. (I3.17P fails to hold, which means there exists a 
constant A > such that 

(3.18) -d t (p(t , x ) - H (t , x , Dcp(t , x ), D 2 (p(t , x ), (p(t , •)) > A > 0. 
Set 

A(t, x; y, z) = d t <p(t, x) + b(t, x; y, z).D(p(t, x) 

(t,x) + f(t,x;y,z). 

We rewrite (13.181) as 

-maxmin ( A(t Q , x ; y, z) + J(t ,x ;y,z)tp) > A > 0, 

where the definition of J is given immediately next to (ll.5p - (ll.6l) . Therefore, for 
each z G Z, there exists y(z) 6 y such that 

(3.19) A(t , x ; y(z), z) + J(t , x ; y(z),z)ip < -A. 

The continuity of A + J in z, uniformly in all other variables, implies 

2 

A (t , ^o; y(z), C) + J(t , xo; y(z),()<p < - gA, 

for all ( E Z fl B(z, r) and some r = r(z) > 0. Obviously, {B(z, r(z)) : z £ Z} is an 
open cover of Z. The compactness of Z ensures the existence of a finite subcover. In 

other words, there are finitely many points {z\, z 2 , , z n } C Z, {y x , y 2 , , y n } C y 

and r l5 r 2 , ...r n > such that Z c[J i B[zi, r^) and 

2 

A(t ,x ;yi,() + J(to,Xo)yi,()<P < -^A for C e S(z i ,r i ). 

Define £> : Z — > y as follows: £)(z) — yj. if z E B(z k ,r k )\ uf"/ B(zi,r^). Clearly, g is 
Borel measurable and 

2 

A(t , ^o; «) + J {to, x ; g(z),z)<p < --A. 
Now use the continuity of J + A in (t, x), uniformly in z, to find a d > such that 

(3.20) A(t, ar; g(z),z) + J(t, x; f?^), z)ip < ~ 
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for all z G Z and max(|£ — t$\,\x — x$\) < "d . The Borel measurable function g could 
be used to define a strategy a for player / on [t , T] as 

a[Z](r,u) = g(Z(r,u)), 

where Z G N(t Q ) and (r,u) G [t ,T] x Q to . 

It is easy to see that a maps a simple predictable process to a simple predictable 
process, therefore by standard limiting argument it follows that a is an r-strategy. 
For the test function tp, we have 

ip(r,X(r))-<f(t ,x Q ) > UfaXirfi-Uifaxo). 

This, along with (13.91) . implies 

(3.21) 

sup E^\ f f(s,X(s),a[Z)(s),Z(s))ds + <f(r,X{r))-<f(t ,x )}>0, 
z(-)eN(t ) ^ Jto J 

where X(-) is the solution of (11 .ip with the control pair (a[Z](r), Z(r)) and initial 
condition (t ,x ). We use Ito-Levy formula and conclude 

(3.22) sup E to ' xo \ [ [A(r,X(r);a[Z](r),Z(r)) 

+ J(r,X{ry,a[Z){r),Z(r))<p(r,X(r))]dr\ > 0. 
For e > 0, (I3.22p means that there exists Z e G N(to) such that 

(3.23) E to > xo {£ [A(r,X(r);a[Z e ](r),Z e (r)) 

+ J(r,X(r);a[Z*](r),Z e (r))<p(r,X(r))]dr} > -e(r-t ). 

We indroduce 

G{r) = A(r, X{r)- a[Z'](r), Z e (r)) + J(r, X(r); a[Z*](r), Z*(r))<p{r, X(r)), 
and rewrite (I3.23P as 

W [ T G(r)l m .y xolllo> ^dr + [ G{r)l u ^ M ^dr\ > -e(r-t ). 
Brh is implies, in combination with (I3.20p . that 
(3.24) 

E^{ jT G(r)l m .y xolllo> ^dr} - ±(r - t )P to (\\X(.) - sgIL < > ~<r - t ). 

Next, apply Cauchy-Schwartz inequality relative to the measure space ([to) r ] x ^t ) 
and get 

E**>( [ T G(r)l m .y xolllo> »dr) 

Jto 

<{E^ j\ U( . ) _ M ^dr) 1 \{E t ^ l\G(r)) 2 drf 

J to J to 

1 Notation: H/iH^ stands for the L°°-norm of a function h(-) defined on [to,r]. 
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=(r-to)^(^o(ll^(-)-^o|lL>^) l (^ f(G(r)) a dr)*. 

J t 

Since the test function ip has bounded derivatives^, we must have 

£^((G(r)) 2 ) <C(x Q ,t Q ,K,T), 



where C(x ,t , K,T) is a constant depending only on x ,t , K,T. Therefore (I3.24p 
gives 



(3.25) / G(r)l|| X( . ) _ x . || L> ,dr}<C'(r-t )P, (||X(-)-xo|L>^) 

Next define the Ito-Levy process £(s) as 

f(s)= / (j(r,X(r);d[Z e ](r),Z e (r))dW(r) 

./to 

+ / / ??(r,X(r);d[Z e ](r),Z e (r);w)iV(dr,^), 

./to >/E 

which means £(s) is a martingale. Note that 



- a; = £(s) + / 6(r,X(r);a[Z e ](r),Z e (r))dr. 

'to 



Hence 



|X( S )-a;o|<|C(s)|+ / |fo(r,X(r);a[Z e ](r),Z e (r))|dr, 

'to 



which implies 



ro-soiiL<iio«+*fr-*b) 



<ne(0ii«+2 

if |r — t 1 < 2(i^+i) • conclusion, if \r — t \ < 2 {k+i) anc " I ICC") I loo < |j tnen 
||^(") — ^oll^o < ^- I n other words, if \r — t \ < 2 {k+i) ' we mus ^ have 



(3.26) 



0* 



F t0 (iix(-)-x |iL>^) <^ (iie(-)iiL> g). 



By Ito-isometry, along with (A.1)|(A.2) and (A. 3) , 

E t0 ' X0 (\£(T)\ 2 ) = [ T E t0 ' X0 (\a(r,X(r);a[Z e }(r),Z e (r))\ 2 )dr 



J t 

+ 11 E t0 ' X0 (\r](r,X(r);a{Z e ](r),Z £ (r);w)\ 2 )v(dw)dr 

J t Je 

<C(r-t Q ). 



This is the only place where boundedness assumption. It is possible to work without this 
assumption, in which case we have to use the moment estiamtes for Levy driven SDE. 
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Now we use Doob's martingale inequality and conclude 
(3-27) PtM(-)\L>^) <^E^(\ar)\ 2 ) 

Now combine the above inequalities f l3.24p .( l3l25|) . (13. 26 p . ( 13^271) and divide through- 
out by t — t and get 

-N'y^toj+^P to (\\X(.) - XolL < tf) < 6 

for some constant N', which is clearly a contradiction to the stochastic continuity!! 
of X(-) for (r — to) small. 

□ 

The following lemma is a consequence of the above theorem. 



Lemma 3.8. Let (A.1WA.2 

viscosity 
we have 



and (A. 3) hold. If u and v are respectively the unique 
viscosity solutions of ( ll.5p -( ll.l|) and f ll.6p - fll.4p . Then, for every (t,x) G [0,T] x M d ; 



u(t,x) > ?7i(t,x) > U(t,x) and v(t, x) < V x (t, x) < V(t, x). 

Proof. The proof is immediate after combining Theorem I3.7[ the comparison princi- 
ple (Theorem 12. ip and Corollary 13.41 [b.)]. 

□ 



To complete the proof of Theorem I2.3[ it is still required to show U(t, x) > u(t, x) 
and V(t, x) < v(t, x). Our proof of this requirement closely resembles [T6l|32], except 
only the fact that the state processes can have discontinuities and the controls are 
predictable. The main idea is to approximate the value function with the help of 
"piecewise constant" strategies/controls, and next follows the description of this 
methodology. 

Let ii = {0 = to < h < t 2 < ■ ■ ■ < t n -i < t n = T} be a partition of [0,T] 
and ||7r|| be the norm of the this partition defined by ||7r|| = maxi<j< n (tj — tj-i). 
The concepts of the 7r-admissible strategies and 7r-admissible controls are defined as 
follows: 

Definition 3.3 (^-admissible controls). A 7r-admissible control Y for player / on 
[t, T] is an admissible control with the following additional property: If 

io G {0,1, ,n — 1} is such that t G [to, ti +i], then Y(s) = y for s G [t,t io+ i] 

and Y(s) = Y tk for s G (t k ,t k+ i\ for k = i + l, ...,n — 1 where Y tk is Tt,t h measurable. 

The set of all 7r-admissible controls for player / on [t, T] is denoted by M n (t). 
A 7r-admissible control Z(-) for player II is similarly defined and the set of all 7r- 
admissible controls for player // is denoted by A^-(t). 

Definition 3.4 (7r-admissible strategies). A 7r-admissible strategy a for player / on 
[t,T] is an a G T(t) such that a[iV(t)] C M n (t) and the following conditions are 
satisfied: If t G [t iQ ,t io+ i) then for every Z(-) G N(t), a[Z]|[ t)ti +1 ] is independent of 



3 See the proof of Lemma POl to conclude that X(-) is stochastically continuous. 
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Z. Furthermore, if Z(-) « Z(-) on [t,tk] then a[Z](tfc+) = a[Z](t k +)-P t a.s. for 
every G {z + 1, n}. The set of all 7r-admissible strategies for player I on [t, T] 
is denoted by r 7r (t). The 7r-admissible strategies for player II are similarly defined 
and the collection of all such strategies is denoted by A,r (t) . 

For every ip G W^°°{R d ), (t,x) € [0,T) and r G (t,T] define 

(3.28) S(t,r)^(x) = mf sup f /(a, y, + V>(*(t))), 

tf^ zeN(t,r) L A J 

where iV(t, r) is the set of all admissible control for player /J and X(-) is the solution 
of (11.11) with the control pair (y,Z(-)) and initial condition (t, x) on [t,r]. It is easy 
to see that if i/j G W 1 ' 00 then r)^ G ly 1 ' 00 . Therefore, given the assumptions 
~ XTJ|(A.2)| and |(A.3)[ the function V n : R d x [0,T] -> E, given by V n (T,x) = g(x) 



and 

(3.29) V v (t,x) = S(t,t io+1 ) J [ S{t k _ u t k )g(x) if £ G [£ io , t io+ i), 

k=i +2 

is well defined. also has a stochastic game representation, the precise form is 
stated as the following lemma. 

Lemma 3.9. For every (t,x) G [0,T] x R d , the function has the following form: 

(3.30) V K (t,x)= sup inf J(t, x; Y, (3[Y]). 

Proof. The main idea behind the proof is the same as for controlled diffusions (no 
jump) [16j Proposition 2.3]. The only exception remains into the fact that we need to 
take the discontinuities of the sample paths and predictability of the control processes 
into consideration. Following [161 Proposition 2.3], the characterization (I3.30P is a 
consequence of the following fact: for every (t, x) G [0, T] x M. d and for every e > 0, 
there exists a e G T w (t) and (3 e G A(t) such that for all Y G M n (t) and Z G N(t), 

(3.31) J(t,x;a € [Z],Z) - e < V v {t,x) < J(t, x;Y, f3 e [Y]) + e. 

The left half of the inequality in (I3.3ip implies the ' <' in (13.301) . To prove the other 
half of (13.301) . we can make use of the right half of (13.311) if we show that for any 
G A(t), there exist Y e G M ff (t) and Z £ G N(t) such that 

(3.32) J(t, x- ct e [Z%Z e ) = J(t, x- Y e , l3[Y e ]). 

The controls Y e and Z e could be defined as follows. Without loss of generality, we 
may assume that t = t io and z G Z. To this end, we let Y io = a[z ] and Z io = /3[Y io ] 
and successively define Y k G M n (t), Z k G N(t) for k = i + 1, , n as 

Z k = f3[Y k ] and Y k = a t [Z k _i]. 

One must show Y k+1 ps Y k and Z k+X ps Z fc on [t» , tfc] for A; = z + 1, , n — 1. 

We employ the method of induction. For = zo + 1, the conclusion is immediate 
from the definition of a e and /3 e as a t is independent of ^-control on [t io ,t ia+ i\. 
Next assume Y k ps* Yfc_i and ~ Zfc-i on [t« , *fc— i] - Note that Y^+i = ae[Zfc] and 
Yfc = Qt e [Zfe_i], and from the definition of 7r- admissible strategies we have Y(t k -\+) = 
Y(t k +). Since Y k , Y k+1 are constants on t k ], we must have Y k+1 ps on [t io , t k ]. 
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Consequently, Z k = f3[Y k ] an d Z k + i = j3[Y k+1 ] implies Z k+1 m Z k on [t io ,t k ]. It is 
now straightforward to check (I3.32p with Z e = Z n and Y e = Y n . 

For simplicity we choose / = 0. For G G W^°°(R d ), y G Y, t G [0,T] and 
r G (t, T], let 

(f)(y; t, t; x, G) = sup E^ x G{X{t)), 

ZeN{t,r) 

where X(-) is the solution of (II. ip with the control pair (y,Z). In view of the 
assumptions (A.1)|(A.2) and (A. 3) , it follows as a consequence that </>(■; £, r, -, G) G 
C b (R d x y) nr"(f). Furthermore 

r)G = inf £, r; x, G). 

y&y 

If * e [^oAo+J for *o e {0,1, ,n- l}, let G n = g, Gj = S(tj,t j+1 )Gj +1 for 

j = i + 1, ,n - 1 and G k) = S(t,t io+l )G io+1 , and thereby G io {x) = V^(t,x) 

Next, partition the spaces R d and y respectively into Borel sets {A k : k = 
1, 2, 3, 4, ....} and {Be : £ = 1, 2, .., L} of diameters less than 5, to be specified later. 
Choose x k G A k and ye G Be- Given 7 > 0, we can choose 5 small enough and 
Vkj = Ve{kj) & y ior k — 1, ....,n and j = i + 1, n, so that 

(3.33) (piyl^tj^t^Xk.Gj) < S(t^ u tj)Gj{x k ) + 7. 
Furthermore, pick Z k pj G N(tj-i,tj) such that, for the controls K, = ye and 

(3.34) E Xk ' t] - 1 G j (X^ ej ) > oiy,: tj ,./,: x fc) G,) - 7. 

The superscripts signify the dependence of the solution X u i of f 1 1.1 1) on the intital 
data (tj_i,x k ) and the control ye- We recall the description of canonical probability 
space to see 

The strategies a t and (3 e can now defined as 

n-l 

(3.35) a e [Z}{r)=xit iQ ,t io+1 ){r)J2yt io XA h {x)+ ^ X(t j ,t j+1 )i.r)J2y* hj XA k { X ( t j)), 

k i=«o+l k 

where the process X(-) is defined successively on intervals [t,t io+ i},[tj,tj + 1] for 
j = i + 1, n — 1 as the solution to (11.11) with Y = a € [Z}. For Y G M(t), we define 



(3.36) &[Y] = X[tioAo+l] (r)^Z Mo (r) XA (x)x^(F(r)) 

n-1 
j=io+l fc/ 

where X(-) is defined on successive intervals as the solution to (11. ip with Z = (3 f [Y] 
and Z kej (r,u) = Z ktj {r,u^- l > T ). 

For any Z G N(t) and Y = a e [Z] or Y G M 7r (t) and Z = /3 e [Y], it now follows that 

v n (t,x) - J(t,x; ■, •) = G i0 (x) - E p *(g(X(T))) 
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j=io+l 

m 

= EPt [ E [^i-iCXCVx)) - ^{Gi(^(*i))|^_x}]^ , 

j'=io+l 

where J(£,x;-,-) stands for either J(t,x;a e [Z], Z) or J(t, x; Y, /3 e [Y]). To conclude 
(13.31)) now we only need to show the following: 

For any Z G N(t) and Y = a e [Z] 

(3.37) Gj^Xfo-i)) > E p < [GWtMlT^] - efe - t,_i) P* - a.s., 
and for any Y G M(t) and K = (3 e [Y] 

(3.38) £ p [G(X(t J ))|^, t3 _ 1 ] > G^pT^i)) - e(tj - t^) P l - a.s. 

Recall the Lemma 13.21 and the discussion preceding it to see that the conditional ex- 
pectations in (13.371) and (13.38)) could now be considered as expectations with respect 
to Pt _ x - Also, X(uj t,ti - 1 y •) is a solution of (11.11) with initial condition \tj-i-, X(tj-xj) 
for P t j -&.e w*'^ -1 . Hence, for X{tj_i) G A k and Y(i,_i) G 5^, we have 

|S Pt ^G(X(^)) - E^i-^GiX^ ))|} = 0(5), 

where 0(5) — > as 5 — >• 0. By (13.331) . we must have 

Gj-\(x k ) > E ttX Gj(X H ^ k ^ j (tj)) - 7 

for each k. Again by Lemma [3.11 Z G N(t) gives rise to Z^*'^' -1 )^) G N(tj~i) and 
we conclude 



G i _ 1 (Xfe_ 1 ))>G(x fc )-0(5) 

> G^XWWfc)) - 7 -C(5) 
>G i (X(t i ))- 7 -20(5), 



which implies (13371) if 7 + 20{5) < e| [vrj 
similar. 



The reasoning for proving (13.38)) is 

□ 



Lemma 3.10. Given the assumptions (A.l), (A. 2) and (A. 3), there exists a constant 
C , depending only on the data, such that 



\V v (t,x)\<C and \V n {t,x) 
for all (t,x), (s,p) G [0,T] x R d . 



V n (s,p)\ < C{\x-p\ + \t-s\ 



Proof. The boundedness of V n is immediate. The Lipschitz continuity of V n in x 
follows from the Lipschitz continuity of J( — )'s, which is a consequence of Lipschitz 
continuity of the data. The argument is essentially the same as in Lemma 13.31 The 
Holder continuity estimate in t follows by suitably mimicking the steps of Corollary 
13.61 after we invoke the stochastic game representation (13.301) of the n- value function 
V n . We leave any further details of the proof to the interested readers. 

□ 
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Thanks to Arzela-Ascoli theorem, in view of Lemma I3.10[ the family (V^)^ will 
have locally uniformly convergent subsequences as ||7r|| — > 0. In fact, it would not be 
difficult to show that any convergent subsequence of V n , as | [ vr 1 1 — > 0, will converge to 
the viscosity solution f ll.6p - fll.4p and the uniqueness of the viscosity solution would 
imply that lirniu-ii^o exists. 



Theorem 3.11. Assume \[AA)\(A.2)\ |(A.3)| and V n is given by f l3729j) . Then the 



limit v = limiiTrii^o exists and it is the unique viscosity solution of fll.6p - fll.4p 

Proof. In view of the preceding remark, we only need to show that any subsequential 
limit of (K-)tt as ||tt|| — > converges to the viscosity solution of (11. 6p . Let v be 
a locally uniform limit of a subsequence of the family (V^)^. We will show that v 
is a subsolution of f ll.6p . and the proof of v being a supersolution is similar. The 
argument is classical in viscosity solution methods. If tp is a test function and v — <p 
has a strict global maximum at (to,Xo), we wish to show that 

ip t (t , x ) + H + (t , x , Dp, D 2 cp, ip(t , •)) > 0. 

Since the subsequence V n — )■ v locally uniformly as \ \ — > 0, there exists (t n , x n ) such 
that (t^, x n ) — > (t , xo) as | |7r| | — t- and (t n , x n ) is a gobal maximum ofV-^ — p. At the 
same time, if U e [^ ,*f 0+ i), then f!3.29p gives V^U.x^) = S(U, ^(x^). 
Therefore 



<p(t n ,x n ) < S{t n ,tl +l )p(tl +l ,-)(x n ). 

The rest of the argument is now trivial, once we notice the following fact: For any 
test function tp, 

5(MM-)- P (0 = g+(v ^ oV ^ ( , )) 

holds as a consequence of Ito-Levy formula. 

□ 

We now piece together above results to conclude Theorem 12.21 and Theorem 12.31 
Proof of Theorem 12.31 . By Lemma 13.91 we have 

V v (t,x) > V(t,x) 

for all (t,x) e [0,T] x R d and any partition 7r of [0,T]. Now we pass to the limit 
1 1 -7T - 1 1 — > and invoke Theorem 13.111 to conclude v > V. The other half of the 
equality has already been obtained in Lemma [3751 therefore V = v. A similar line of 
arguments could be employed to conclude U = u. 

□ 

Remark. We can use Theorem 12.31 to conclude from Theorem 12.11 that the value 
functions are Holder continuous in time. 

Proof of Theorem \2.2\ . It is sufficient to argue for f)2.6p . proof of (12 .7p is similar. Fix 
r e (0, T] and denote the right hand side of (J2J| by V*(t, x) for (t, x) e [0, r) x R d . 
Without any difficulty, in 12. 6[ it is enough to consider the controls Y's and the 
strategies /3's defined on \t, r], in place of the full interval \t, T\. Then by Theorem 
12.31 V* is the viscosity solution of (I1.6P in [0,r] with V*(r,x) = V(t, x). On the 
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other hand, V(t, x) is the viscosity solution of the same problem. We conclude by 
uniqueness that V = V*, and thereby proving the theorem. □ 

4. Proof of the verification theorem. 

We begin this section with some essential technicalities related to Lebesgue points 
of a measurable function with values in a Banach space. Some of these facts are 
discussed in [TS], rest are added here to tackle the additional subtleties due to the 
nonlocal nature of Isaacs equation. 

Definition 4.1. Let B be a Banach space and 7 : [a, b] — > B be measurable and 
Bochner integrable at the same time. A point s G [a, b] is said to be a right Lebesgue 
point of 7 if 

lim- / \j(r) - j(t)\]s dr = 0. 
Ho h J s 

The following result holds (see [12] for the proof). 

Lemma 4.1. Let 7 : [a, b] — > B be measurable and Bochner integrable. Then almost 
every point in [a, b] is a right Lebesgue point of 7. 

From now onward we drop the subscript t from (Q t , Pt) an d simply write (Q, P). 
For a positive integer n, the next lemma ensures that any member of Lj- (t, T; M n ) 
can be thought of as Bochner integrable when viewed as a map from [t, T] to 
L 1 (Q; W 1 ). 

Lemma 4.2. Any 7 e Lhp (t, T\ M n ) is Bochner integrable when regarded as a junc- 
tion from [t, T] to L 1 ^; R n ). 

Proof. Except the null sets, the sigma algebra Tt,T is generated by a cadlag process. 
As an implication it follows that, excluding the null sets, is generated by a 
countable family of subsets of Q. We combine this fact with separability of R n and 
argue along the lines of ([13]; p. 92) to conclude that L 1 (fi,M n ) is separable. It 
follows from the definition of L x Tt (t, T; M. n ) that 

|7(>", •)\iA(ws.»)dr < 00. 

Hence, it only remains to show that the map s — > 7(s, •) is measurable as a function 
from [t, T] to L 1 (Q; M. n ). To this end, we invoke the separability of L 1 (Q; M. n ) and con- 
clude that measurability is equivalent to weak measurability. This means it is enough 
to prove r i-> E{^{r, u).p(u)) is Lebesgue measurable for every p e L°°(fi;IR n ), but 
this is obvious once we apply the Fubini theorem as 

eJ \j(r,u).p(u)\dr <\\p\\ L <*>(n-s») J \l(r, ')\iA(a-p»)dr < 00. 

□ 

A crucial technical difference we have here, in comparison with [19], is the discon- 
tinuity of the state processes. However, these processes are stochastically continuous 
and the next lemma is consequence of this property. 
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Definition 4.2 (stochastic continuity). A stochastic process (X(s)) a < s <6, defined 
on a probability space (Q, J 7 , P), is called stochastically continuous if for every e > 
and s G [a, b] 

\imP(\X(r)- X(s)\ > e) = 0. 

r— >s 

We have the following lemma. 

Lemma 4.3. Let X(-) be the solution of (II. ip for a pair of admissible controls 
(Y,Z), then X(-) is stochastically continuous and for a continuous function ip G 
C p ([0, T] x R d ) , for p = 1 or p = 2, it holds that 

limE[-J if>(r,X(r))dr) = E(ip(s,X(s))) 
Proof. The stochastic continuity X(-) is a consequence of 

X(t)-X(s)= b(r,X(r);Y(r),Z(r))dr+ a(r,X(r);Y(r), Z(r))dW(r) 



+ / / r}(r,X(r~);Y(r),Z[r);w)N(dr,dw), 



E 



and the assumptions on the data. It follows from the above realtionship that 
E\X(r)-X(s)\ 2 

pr pr 

<3E[ (b(r,X(r);Y(r),Z(r)))dr] 2 + 3/ E(a 2 (r, X(r); Y(r), Z{r))dr 



+ 3/ E(7] 2 (r,X(r);Y(r),Z(ry,w))u(dw)dr 

Js J ' 

<K{\s -t\ + \s- r\ 2 ), 
where we have used Ito-Levy isometry. Therefore by Chebyshev's inequality, we have 

P(\X(T)-X(s)\>e)<^(\s-T\ + \s-T\ 2 ), 

which proves the stochastic continuity of X(r). 

Set L(r) = tp(r,X(r)) and F(r) = E[L(r)}. Assume that ip E C x ([0,T] x R d ). 
Thanks to the continuity of ip, L(r) is also stochastically continuous. By Ito-Levy 
isometry, it is trivial to check that X(r) has finite second second moment for all 
r G [t,T], and the bound is independent of r. Therefore F{r) is a bounded function 
on [t,T\. 

\F(r)-F(s)\< I \L(r) - L{s)\dP + I \L(r) - L(s)\dP 

J\L(r)-L(s)\<8 J\L(r)-L(s)\>5 

< 5 + E[\L(r) - L(s) | l\ L ( r )-L( s )\>s] 

<5+ [E(\L(r) - L(s)\ 2 )]^[P(\L(r) - L(s)\ > 5)]' 

< 5 + C[P(\L(r) - L(s)\ >6)]K 
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which goes to as s — > r and 5 — > 0. Therefore F(r) is continuous in r and 
hence every point is a lebesgue point. Now, after using Fubini's theorem, dominated 
convergence theorem and the continuity of F , we have 

/l f s+h \ 1 f s+h 

\imE[ — / ip(r, Xiryjdr ) = lim — / F(r)dr = F(s), 
hio \h J s J h\a h J s 

and this proves the lemma. □ 

Alternative proof of Lemma 14.31 for p £ {1,2}. Since X(-) is Cadlag ( i.e. right con- 
tinuous ) and if) is continuous, one must have j- ip(r,X(r))dr = ip(s, X(s)). If 
ip £ C p ([0, T] x W d ), for p = 1 or 2, and since X(-) has finite second moment, we can 
apply dominated convergence theorem and conclude 



lim£ - 



s+h 



ifi(r, X(r))dr 



lim — 

hiO h 



s+h 



F(r)dr = F(s) 



□ 



Remark. The first proof of Lemma 14.31 also works for any p £ N, as it is possible to 
prove boundedness of any 2p-th moment of X(-). It also says that F(-) is continuous. 
However, the alternative proof is much more compact and to the point. Though the 
second proof is enough conclude the lemma, but it only establishes right continuity 
ofF(-). 



Lemma 4.4. Let the assumptions (A.l) , (A. 2) and (A. 3) be satisfied and for (t, x) £ 
[0,T]xR a! , (Y(-),Z(-)) bean admissible pair of controls, andX(-) be the correspond- 
ing solution of (11. ip . Define the processes 

Zl (r) = b(r,X(r);Y(r),Z(r)), z 2 (r) := aa T (r, X(r);Y(r), Z(r)), 

z%(r, w) = rj(r, X(r); Y(r), Z(r); w)rj r {r ) X(r); Y(r), Z(r); w), 

z 4 (r, w) = r)(r, X(r); Y(r), Z{f)\ w). 



Then 
(4.1) 

(4.2) 

and 

(4.3) 



lim E— 

hiO h 

limi?— 

hiO h 



s+h 



\zi(r) — Zi(s)\dr = 0fora.e. s E [t,T] for i £{1,2}, 



s+h 



|z 4 (r, w) — z^{s, w)\dr = for a.e. s £ [t, T], for all w £ 



lim E— 

hiO h 



i+h 



\zs(r, w) — z 3 (s, w)\v(dw)dr = for a.e. s £ [t, T}. 



Proof. Fix w £ R m . Then, by |(A.1)|(A.2)| and |(A.3)[ z u z 2 ,z A (-,w) £ L 1 ^ (t,T;M) 
for B := R^S^R^ respectively. By Lemma [4.21 each of them is Bochner integrable, 
when viewed as L 1 (fi, B)-valued maps and we conclude that the set of right Lebesgue 
points of Zj's, as maps from [t,T] to L 1 (fi,B), is of full measure in [t,T]. This gives 
(14. ip . and (14.21) except "for all w" part. This implies that (14 .2p holds for any 'any 
countable dense subset of R m '. As z^(r,w) is continuous in w uniformly in other 
entries, we have the full conclusion. 
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We now prove (IP) . Define ft' = ft x M m \{0} and // = P <g> i/. Then (ft',//) is 
measure space with the sigma algebra J 7 x i3(IR' m \{0}) and z 3 (r, ■) £ L 1 ((ft / , y u); S d ). 
For the same reasoning detailed in Lemma 14.21 z 3 is Bochner integrable when con- 
sidered as a map from [t,T] to L 1 ^',//); § d ). Therefore we can apply Lemma 14.11 
to conclude the result. 

□ 

Lemma 4.5. Le£ ip : [t, T] x M d i— y M. n be continuous and satisfy ( 12. 9 p wi/i /c = 1. 
7/ (14. 2 p zs satisfied for some s £ [£, T], then 

(4.4) 

(r, X(r) + 2 4 (r, w)) — ip(s, X(s) + z±(s, w))\P{dw)dr 



lim E 



h 



0. 



where v(dw) := min(l, \w\ 2 )u(dw) is a bounded Radon measure. 
Proof. The proof is done in two steps. 

Step 1. Let ip be Lipschitz continuous in s and continuously differentiable in x such 
that 

\ip(s,x)\,\Dij;(s,x)\<C(l + \x\) for (s,x) £ [0,T] x M d . 

Then 

|-0(r,X(r) + « 4 (r,«i)) - i/)(s,X(s) + z 4 (a,u;))| 

<C[|r - a| + (|X(r)| + \X(s)\ + |z 4 (r,u;)| + |-z 4 (s,w)|) 

x (\X(r) - X(s)\ + \zt(r,w) - z 4 (s,w)\)]. 

By Ito-Levy isometry, X(r) has bounded second moment for all r £ [t,T]. With 
this, we now use boundedness of rj and Cauchy-Schwartz inequality to obtain 



E- 



<C 



h 



h 



s+h 



s+h 



X(r) + Zi(r, w)) — vf)(s, X(s) + z 4 (a, w))\£>(dw)dr 
[\r -s\ + (E\X(r) - X(s)\ 2 )^)u(dw)dr 



E 



s+h 



\z±{r, w) — z 4 (a, w)\v(dw)dr 



We now use (14. 2 p and dominated convergence theorem to pass to the limit h 4- and 
conclude 

Step 2. If i) : [t, T] x R d ++ W 1 be continuous and satisfies with k = 1. Then, 
for every e > 0, there exists ^ satisfying the conditions of the first step such that 
\tp(s, x) — tjj 6 (s, x)\ < Ce(l + \x\). Then 



lim E— 

hiO h 



< MmE- 

hiO h 



s+h 



s+h 



\ip(r, X(r) + z±(r, w)) — ifj(s, X(s) + z 4 (a, w))\v(dw)dr 



\tjj e (r,X(r) + z A (r,w)) - ip £ (s,X(s) + z A (s,w))\v(dw)dr 
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where the right hand side goes to zero as e — > 0. 



□ 



Proof of Theorem 12.61 For the sake of simplicity we use the following abbreviated 
notations: 



f*(s) = f(s,X*(s);Y*(s),Z*(s)), g*(s) = g(X*(s)), 
b*(s) = b(s, X*(s); Y*(s), Z*(s)), a*(s) = a*(s, X*(s); Y* (s) , Z* (s)) , 
r 1 *(s,w) = V *(s,X*(sy,Y*(s),Z*( S );w). 

Choose r G [t, T] so that (jUJ holds at r for zi{-) = &*(•), z 2 (-) = a*(-)a*(-) T ; 
(I4.3P holds for z 3 (-,w) = r]*(-,w)r]*(-,w) T and (14. 2 p holds for z^(-,w) = rj*(-,w). By 



Lemma [4.4[ the set of all such r's in [t,T] is of full measure. From Section 2, recall 
the identification 



where P\ = Pt )T and P 2 = P T . We use E Pl and E P2 for expectations with respect to 
P\ and P 2 respectively. For any J 7 ^ measurable function ip(u) on (Q, P) we have 



X(w) = E p \x{ux,u 2 )\F UT ] = E^ p *[y{u u u 2 )\F ttT ] = E^{ip{u u uj 2 )), P 1 - a.s. 



i.e. Pi-a.s. is deterministic in (Q T , P 2 ) , where u = (u\,u 2 ) G £\ r X fi r . There- 
fore X*(r), $ 1 (r),p 1 (r), q ,1 (r) and Q 1 {t) are all Pi — a.s. deterministic in (Q r ,P 2 ). 
It has already been pointed out in Section 3 that, on (fi r ,P 2 ), X*(s) s > T has the 



Pi-a.s, where (W T , N T ) be the process driving the dynamics on (Q T , P 2 ). We wish to 
apply Ito-Levy formula to §l(s, X*(s)) on (Q T ,P 2 ), relative to the dynamics (14. 5p . 
Firstly, is deterministic on Q T (Pi — a.s.) and secondly it is C 1,2 , hence Ito-Levy 
formula is applicable. To this end, we simply write 4> for <&\ and apply Ito-Levy 
formula to conclude, for h > 0, 



= n ttT x fi T and P = Pi ® P 2 



dynamics 



(4.5) 




0(r + /i,X*(r + ft))-0(r,X*(r)) 





+ / / U(r,X*(r) +r/*(r,io)) - <j>(r,X*(r)) - r)*D4>(r,X*(r)) )u{dw)dr 
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2!) 



+ 



[<P(r,X*(r~) + r](- ■ ••)) - 0(r, X*(r~))] N T (dr, dw), P l 



a.s. 



We divide the above equality by h, apply E P2 and use the fact that u — <fi has a 
global maximum at (t,X*(t)) to obtain 



(4.6) 



E P2 t[u{t + h, X*(t + h)) - u(t, X*(t))] 



<E P * 



h 

I r r T + h 

h 



[d s( p(r, X*(r)) + (D<j>{r, X*(r)); b*(r)) 
+ -Tr (a* (r)D 2 <p(r, X*(r))a*(r))]dr 



+ 



T+h 



[r, X*{r) + rj*{r, w)) - 0(r, X*{r)) 
— 77* (r, w)D(f)(r, X(r)) \ v(dw)dr 



Pi- a.s. We are interested in passing to the limit h 4- in (14.61) . and we do so 
by separately considering each term from the right-hand side. We begin with the 
simplest one. 

Since d s 4> is continuous, we can apply Lemma I4T51 for ip = d s <p [relative to (fl T , P 2 )] 
and get 

(4.7) lim£ P V [ d s (f)(r,X*(r))dr = dMr, X*(r)), P 1 -a.s. 
HO h J T 

Next we treat the term resulting directly from the presence of jumps. Let us denote 
J( r ) =E P2 \ [ U(r,X*{r) + r]*{r,w))-(f){r,X*{r)) 

— 77* (r, w)D(f)(r, X{r)) s jv{dw) 
We use Fubini's theorem to justify the identity 

(4.8) / ^(r,X*(r) + ?7*(r,w))-(/)(r,X*(r))-r/*(r,w)D(/)(r,X(r)))z/(rf7j;) 

(1 — p)( / {D 2 (p(r, X*(r) + prj*(r,w))rj*(r 1 w);rj*(r,w))p(dw))dp 
Je 

(1 — p)( / Tr [77* (r, w)rf(r, w) T D 2 (j)(r, X*(r) + pr)*(r, w))]is(dw))dp, 
where we have also used properties of trace. Therefore 



(4.9) I(r) - J(r) 

(l — p)( I Tr( [77* (r, 777)77* (r, w) T — 77* (r, 10)77* (r, w) T ] ) 

x D 2 (/)(t,X*(t) + pr)*(T,w)))u(dw))dp 
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+ / (l-p)( / Tr(r]*(r,w)r]*(r,w) T [D 2 (f)(r,X*(r) + pr)*(r,w)) 
Jo ^ JE 

- D 2 <f)(T,X*(T) + pr]*(T,w))])v{dw)^dp. 
Since D 2 <p is continuous and prj*(r,w) satisfies (14. ip at r, upon denoting 

/'(r,r) = f \D 2 <j)(r,X*(r) + pr]*(r,w)) - D 2 (f)(r , X* {r) + prf{r,w))\v{dw) 
Je 

where v(dw) = min(l, \w\ 2 )u(dw), by Lemma [4.51 we must have 



(4.10) 



= \imE- 

h\.o h 



T+h 



I'(r, r)dr 



Eh 



T+h 



l'(r,T)dr\F tiT ] 



lim E Pl 

h+0 



E p >[ 



h 



-+h 



I'(r, r)dr\ 



where we have also used Lemma [3.21 Also note that zs(-^w) = r)*r]* T (-,w) satisfies 
(14. 3 1) at r and hence, after a similar reasoning as above, we have 

-r+h 



(4.11) 



= \imE Pl 

hi 



h 



Tr \rfrjj* T {r, w) — rf rjj* T [t , w)\ v(dw)dr 



We now recall the growth properties of rj, (ft and use them along with Fubini's 
theorem to get 

-r+h 



(4.12) 



E P2 - 
h 

< N(t) 



\I(r) - I{r)\dr 



-E p > 



T+h 



| Tr [i]*r]* T (r, w) — i]*i]* t (t, w)~\ \u(dw)dr 



+ N j\l — p)E p - [1 J T J k I'(r, r)dr] dp, 



where N depends on data and N{r) depends also on X*{r) . Fix any sequence {hj}j 
such that hj I 0. From ( fl~T0]) and (HTf]) . we observe that E P2 [i J^ +hj r(r,r)dr] 

and E p *\. j^ +hj j E (|Tr [q*r]* T (r, w) - r]*r]* T (r, w)] \u{dw)dr goes to in L^^V, P x ). 
This means there exists a subsequence {hi)i of (hj)j such that 

"T + hl 



1 /"r+n; 

lim£ P2 [— / /'(r.^drl = 0, 



li m ^2 



(|Tr [77*77* (r,w) — r)*rj* (r,w)'\\i i (dw)dr = 



Pi-a.s. We use the above equalities along with (I4.12p to conclude 



(4.13) 



lim E P2 — 

hi±0 hi 



-hi 



\I(r)-I(T)\dr = 0, Pi-a.s. 



Next we treat the term resulting from the drift of the dynamics. 
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(4.14) 



E p >- 



h 



r+h 



,E ?2 - 



h 



I (D0(r, X*(r))- 6*(r)} - (D<f>(r, X*(r)); b*(r))\dr 



\D</>(r,X*(r)) - D<j)(T,X*(T))\dr 



+ \(DcP(r,X*(r))\E p - 1 -J |6*(r) - b*(r)\dr. 
We use continuity of Dip to apply Lemma 14.31 and get 

i rr+h 

(4.15) \imE P2 - \D(f>(r,X*(r)) - D(p(r, X*(r))\dr = 0, P x - a.s. 

h\a h J T 

Also, by the choice of r, z\{-) = b*(-) satisfies (14. ip i.e. 

= lim^| / \b*(r)-b*(r)\dr 
hio h J T 

r+h 



= ljmE(E[- J \b*(r)-b*(r)\dr\T tiT ] 

= \imE Pl (^E P2 [-]-J^ + |6*(r) - b*{r)\dr^j, 

which implies that E P2 \ \b*(r) - b*(r)\dr converges to in L 1 ((f2t jT , Pi) 
Therefore, there exists subsequence (hi/) of (hi) such that 



(4.16) 



lim E P2 — [ + ' 16* (r) - b*(r)\dr = 0. 



We combine (I4.15p - (l4.16p to conclude, Pi — a.s. 



i pr+h 

(4.17) lim£ P2 — / { 

fy40 hi' J T 



(D<t>(r,X*(r));b*(r)) - {D<j>{r,X*(r))-b*(T))dr = 0. 



Finally, we consider the term resulting from the diffusions. We routinely use formulas 
involving traces of matrices to write 



Ih 



E P2 

--E P2 
+ E P2 



i r +h i. 



Tr(a*(r)a*(r) T D 2 (f)(r,X*(r)) - a* {t)ct* {rf D 2 <P(t, X*(r)))dr 



i r +h i 



h ~Tr(a*(r)a*(ry[D 2 <j>(r,X*(r)) - D 2 <f>(r, X*(r))])dr 



i r +h i. 



h f ^Ti([(x*(r)a*(r) T - a*(T)a*(T) T ]D 2 (j)(r,X*(r)))dr 

and then we invoke the same set of arguments used above to conclude that there 
exists a subsequence (hi») of (hi>) such that, Pi — a.s., 

(4.18) 

i r T + h i" i / \ ~i 

-Tr(a*a* T (r)D 2 (j)(r,X*(r)) - a*a* T (T)D 2 (j)(T,-))dr =0. 



lim E P2 



-hi 
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Summing up ( I4.7p . (l4.13p .( l4.17p and (I4.18p . with ( 12. lip in mind, for any sequence 
(hj) I there exists a subsequence (hi") such that, Pi — a.s., 



(4.19) lim E P2 



h v . 



r+h 



[d s <P(r, X*(r)) + (D(f>{r, X*(r)); b*(r)) 
+ ~Tr(a*(r)D 2 (f>(r,X*(r))a*{r))]dr 



+ / / (cj)(r,X*(r)+r}*(r,w))-(j)(r,X*(r)) 
J Je 

— rj*(r, w)D(/)(r, X*(r))^v(dw)dr 
-d s <P(r,X*(r)) + (D<f>(T,X*(r));b*(r)) + ~Tr (a* (^D^t, X*(r))a*(r)) 
+ / {^X^r) + V %r,w)) - ^X^r)) ~ r ] %T,w)D4 > (r,X*(r)))iy(dw). 



Passing to the limit along a suitable subsequence for which lim sup is achieved in 
( 14. 6 p and using (I2.10p . we have 

lim sup E P2 \ [u{t + h, X*(r + h)) - u{r, X*{r))] 

(4.20) <p\t) + (q\r),b*(r)) + \^{a* a* T {^Q 1 {t)) 

+ J(r, X*(r); Y*(r), Z*(t))**(t, X*(r))} , P 1 - a.s. 

Note that E(\\& s \\ 2 ia - )ds < oo, and therefore E(\\¥ s \\ 2 ia - ) < oo for a.e. 
s G [t, T] and i G {1,2}. Therefore, without loss of generality, we may assume 

Em 



a 'i^w <ooi - e - 



(4.21) 



Now use ( 14. 6p . and boundedness of the data to conclude 



E P2 



u(T + h,X*(T + h))-u(r,X*(r)) 
h 



^ C M\cl-\Q T )\ [ (l + E p *\X*(s)\)ds 

<CM\cl'\Q T) { ^ + \X*{r)\+C'^T^)ds 
(4.22) <C||0|| Ci1 , 2(Ot) (1 + \X*(t)\ + C) := p T (u;), 

where h < 1 and we have used Lemma IA.11 Also, by Cauchy-Schwartz inequality 
and (14.21 j) . we have E{\p T (uj)\) < oo as X*(t) has bounded second moments. 
By (I4.22p . we can now apply Fatou's lemma and use (14.201) to obtain 



h 

lim sup E— 



lim sup E— [u(t + h, X*(t + h)) - u(t, X*(t))] 



E[u(t + h, X*(t + h)) - u(r, X*(t))] \F ttT 
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= lim sup E E P2 -[u{T + h,X*{r + h))-u{T,X*(T))] 
hio L h 

<E \ lim sup E P2 | \u(t + h,X*(T + h))- u(r, X*(t))] 

<e[ P \t) + (q\r),b*(r)) + ~Tr(a* a* 7 \r)Q l (r)) 
+ "/(r, X*(r); F*(t), Z*(t))^(t, X*(t))" 
for almost every r G [t,T]. To this end, we define G(r) = E{r, X*{t)) and observe 
(4.23) i: G ( T + /! ) - G ( T ) 



lim sup 



h 



<E 



1, 



+ J(r, X*(r); Y*(t), Z*(t))& t (t, X*(t)) 
for a.e. r e [i, T\. We proceed similarly as in (I4.22p and argue, for all h > 0, that 



G(r + fe) - C7(r) 
h 



< E 



^ T (T + h,X*(T + h))-^ T (T,X*(T)) 



T+h 



h 

^[11^11^(^,(1 



< c 



1 

Ih 



T+h 



EiW&Wi^ 



(4.24) 



<CE(\\<!>1\\ 2 



TII <3l (Qt) 



)ds 



X*(s)\)]ds 

2 1 
h 



E(l + \X*(s)\ 2 ) 



where we have used Ito-Levy formula, Cauchy-Schwartz inequality, boundedness of 
the data and boundedness of second moment of X*(-). By our assumptions, the map 
r i — y E(\ \ 2 C1 ,2(q t )) is Borel measurable and a member of I^QO, T]). Therefore the 
map p'(r) is in L 2 ([0,T}). We now apply Cauchy-Schwartz inequality once more and 
conclude p'(r) e L\[0,T}). 

We now refer to the explanation in J2U] arid conclude, in view of (I4.24p . that the 
Lemma 5.2 of [3U section 5.2] is valid for the function G(s). We apply this lemma 
to G(s) and use (14.231) along with (12.111) to obtain 

G(T) - G(t) <-E J f*(s)ds 
i.e. E{g{X*(T))) - u(t, x) < -E I f*(s)ds 



or J(t,x;Y*,Z*) <u{t,x). 

Since the Isaacs condition (12. 3p holds and the value of the game exists i.e. V(t, x) = 
U(t, x) , we use Theorem 12. 31 and comparison principle from Theorem 12 .11 to conclude 

J(t,x;Y*,Z*) < u(t,x) < V(t,x) = U(t,x), 
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which gives half of the requirement for (I2.14p . The other half also follows after we 
apply similar machinery to v(t,x) and the conditions (I2.12j) . (l2.13p . 

□ 

Remark on optimality of (Y*,Z*). It is perhaps misleading to call the con- 
trol pair (Y*,Z*) in Theorem 12.61 as optimal merely on the basis of the equal- 
ity dZHJ. If for all Z G N(t), there exist (p z , q z , Q z ; $ z ) G L 2 Tt (t, T; R) x 

L% (t,T;R d ) x L% t ,(t,T;S d ) x L^ t (t,T;C{' 2 (Q T )) such that $ z is progressively 
measurable and (12.101) . (12.111) hold for (Y*,Z) , then the same proof works and 
one can conclude J(t, x;Y, Z*) < u(t,x) < V(t, x) = U(t,x). Also, for every 
Y G M(t), if conditions similar to f l232|) - fl2~T3l ) hold for the control pair (Y, Z*) 
then one can show that J(t,x;Y, Z*) > v(t,x) > U(t,x) = V(t,x). In such a sce- 
nario, the pair (Y*, Z*) will be a saddle-point control pair satisfying J(t, x; Y*, Z) < 
J(t, x; Y*, Z*) < J(t, X] Y, Z*) for all admissible control pair (F, Z). 

Appendix A. Proof of some techincal Lemmas 

Proof of Lemma |2"31 . Fix (t, x) e Q T and (p,q,Q) G D^ + v. Let (p = (p\p, q, Q] 
(merely indicates the dependence on p,q and Q) such that 

[ip,ip t ,Dip,D 2 ip](t,x) = [v(t,x),p,q,Q] 

so that, by Lemma [2. 4[ v — (p has strict global maximum at (t, x) relative to the set 
of points (s, y) such that s > t. Without loss of generality we may assume t = 0. 
Now it is easy to see that, for small fi, the function v — <p — ^ will have strict global 
maximum at {t^,x^) and {t^,x^) — > (0,x) as n — )■ 0. Therefore, from Definition 12. 1[ 
it follows that 

-(ptit^Xp) - F(t ll ,x fl ,Dip(t fl ,x /1 ),D 2 ip(t II ,x ll ),ip(t ll ,-)) < -— 

for F = H + or H . We get the desired result by passing to the limit ^ | and 
invoking continuity of H + or H . This gives the 'if part, the proof of 'only if 
trivially follows from Lemma [2.41 □ 

Proof of Lemma 13.31 The Lipschitz continuity and boundedness of V and U are 
straight forward consequences of uniform Lipschitz continuity and uniform bound- 
edness of J(t, x; Y, Z) in x. As a result, it is enough to prove [a.)], in which case the 
uniform boundedness is evident from the boundedness of the data. The Lipschitz 
continuity will follow if we can prove, for x, y G M. d , 

(A.l) E p *(\X t>x -X t J) <C\x-y\, 

where X tyX and X t)V are solutions of (II .ip starting at t, respectively from the points 
x and y with the same control pair 7 = (Y, Z). We proceed as follows: 
Set Z(s) = X t>x (s) — Xt >y (s). By applying Ito-Levy formula , we have 

E p *(\Z{s)\ 2 ) =\x-y\ 2 

+ E P <{ J [2Z(r).6(r,X t):r (r),X^(r);7(r)) 
+ Tr(a C T T )(r,A M (r),X ti ,(r); 7 (r)) 
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1 77(7", X t>x (r), X ttV (r), w; j(r))\ 2 v(dw)] dr 

E 

where 

b(r, X t>x (r),X t , y (r)); 7 (r)) = b(r, X t)X (r); 7 (r)) - b(r, X t , y (r); 7 (r)), 
^^,x(r),X t)y (r)); 7 (r)) = a(r,X tjX (r);j(r)) - a(r,X tiy (r);j(r)), 
fj(r,X t!X (r),X tiy (r)),w;j(r)) = r)(r, X t , x (r); 7 (r); iw) - ??(r, X t)2/ (r); 7 (r); w). 

We invoke the Lipschtiz continuity assumption on the data and obtain 

E Pt (\Z(s)\ 2 ) <\x - y\ 2 + C J" E Pt (\Z(r)\ 2 )dr, 

where we have used Fubini's theorem. Now we apply Gronwall's inequality to deduce 

E Pt (\Z(s)\ 2 ) < (1 + J\ Cr dr)\x-y\ 2 . 

In other words, we have just derived 

E p <(\X tiX (s)-X t , y (s)\) <C\x-y\ 2 , 

which implies ( 1A.1|) after applying Cauchy-Schwartz inequality. □ 

We close this Appendix with the following known estimate for stochastic differen- 
tial equations. 

Lemma A.l. Let X(-) be the solution of (11. ip starting from a point x at time t, 
corresponding to an admissible control pair (Y, Z). Then, it holds that 

(A.2) EF*(\X{t) - x\) < Cv^F^t, 

where C is a constant depending on the data. 

Proof. Without loss of generality we may assume |r — t\ < 1. We have 

X(t)-x= b(s,X(s);Y(s),Z(s))ds+ cr(s, X(s);Y(s), Z{s))dW{s) 



+ / / r}(s,X( S -);Y(s),Z(s);w)N(ds,dw). 
h J e 



Therefore, by Ito-Levy isometry, we conclude 



E\X(t)-x 



2 



< 3E [J t b(s,X(s);Y(s),Z(s))ds] 2 + 3 J E\a(s, X(s);Y(s), Z(s))\ 2 dsZ(s))ds 

+ 3 / f E\r)( Sl X(s);Y(s),Z(s);w)\ 2 u(dw)ds 
Jt Je 



<K(\t -t\ + \r-t\ 



where we have used the bounded ness assumption on the data. Sine \r—t\ < 1, flA.2j) 



follows trivially from above estimate after applying Cauchy-Schwartz inequality. 

□ 
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